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Abstract 

A Banach space valued graphon is a function W : (ft, A, tt)^ —>■ Z from a probability 
space to a Banach space with a separable predual, measurable in a suitable sense, and 
lying in appropriate L^-spaces. As such we may consider W(x, y) as a two-variable random 
element of the Banach space. A two-dimensional analogue of moments can be defined 
with the help of graphs and weak-* evaluations, and a natural question that then arises is 
whether these generalized moments determine the function W uniquely - up to measure 
preserving transformations. 

The main motivation comes from the theory of multigraph limits, where these graphons 
arise as the natural limit objects for convergence in a generalized homomorphism sense. 
Our main result is that this holds true under some Carleman-type condition, but fails in 
general even with 2^ = R, for reasons related to the classical moment-problem. In partic¬ 
ular, limits of multigraph sequences are uniquely determined - up to measure preserving 
transformations - whenever the tails of the edge-distributions stay small enough. 


1 Introduction 

Moment determinacy deals with the question of whether a given type of probability measure 
is uniquely determined by its moments. In the classical settings, the theory is rich and well 
understood. For instance, if the probability measure lives on a bounded interval (Hausdorff 
problem), then knowledge of the moments is enough to recover the measure. The same holds 
true for the vector-valued version, where the measure is supported in a bounded domain of 
for some finite k. The notion of moments has to be slightly adapted though: to guarantee 
uniqueness, we need mixed moments, i.e., the expectations of a”-’ , where Xj is the j-th 
coordinate of the random vector (1 < j < k), and the aj-s are nonnegative integers. 

However, if the support is unbounded (cf. Stieltjes and Hamburger problems), there is no 
general positive or negative answer to moment determinacy, and additional conditions (Car- 
leman, Krein, etc.) are needed to prove or disprove uniqueness, see e.g. the monograph ID by 
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Akhiezer. 


In a somewhat more general setting, given a measurable function / : [0,1] —> M, we have an 
induced probability measure on M. Knowing the moments of this probability measure, we may 
wish to recover / itself. Clearly this is not possible, but if the measure is moment determinate, 
we may still recover a great deal of information about /. For instance, we may find a canonical 
monotone increasing representation f : [0,1] ^ M, where f' is determined up to a null-set. 
Also, we may find measure preserving transformations of [0,1] that transform / and f into 
a.e. equal functions. A similar result holds for / and f taking its values in where the 
monotone reordering is extended to the lexicographic ordering. 

In a recent paper by Borgs, Chayes and Lovasz ([3]), the authors considered a variant of the 
above Hausdorff question, involving an extra dimension in the domain of /. Namely, they 
investigated bounded symmetric measurable functions / : [0,1]^ —>■ M. Such two-variable func¬ 
tions also induce a probability measure on [0,1], but the structure of the domain means that 
there is an added spatial correlation in the function values. They proved that with an ap¬ 
propriate notion of generalized moments that are adapted to the extra spatial dimension, all 
such functions are uniquely determined by their generalized moments, up to measure preserv¬ 
ing transformation of the variables. Note however, that there unfortunately is no canonical 
reordering of the interval that would yield a "monotone" function in this two-variable setting. 
The motivation for studying such functions comes from the theory of limits of simple dense 
graphs, developed by Borgs, Chayes, Lovasz, Sos and Vesztergombi mu and Lovasz and 
Szegedy |12) . Symmetric measurable functions W : [0,1]^ —)■ [0,1] represent limit objects for 
graph sequences under a combinatorial/probabilistic notion of convergence connected to homo¬ 
morphism densities. The deep connection between analysis and limit theories of combinatorial 
objects is further highlighted in the paper |13) by Lovasz and Szegedy, where Szemeredi’s 
Regularity Lemma is reformulated and given analytic interpretations. We also note that the 
question of uniqueness in the limit theory for hypergraphs was treated by Elek and Szegedy in 
|6], but their methods were of a fundamentally different nature, making use of ultraproducts. 
Further developments in this field have led to the investigation of limits of multigraphs with 
no bound on the number of multiple edges between nodes, and more generally to limits of dec¬ 
orated graphs. For the multigraph setting, this at a first glance simply corresponds to passing 
from bounded to unbounded functions. But it turns out that for combinatorial reasons one 
expects the limit functions to take measures as their values rather than simply a real number. 
In |9], Lovasz, Szegedy and the author developed a general functional analytic framework that 
allows one to handle the various possible combinatorial interpretations opened up by the multi¬ 
graph/decorated graph setting and compare the corresponding convergence notions. 

The limit objects/graphons this generalized setting leads to are symmetric, weak-* measurable 
functions W : [0,1]^ ^ -2, where Z is a Banach space with separable predual (typically a space 
of measures that depends on the specific combinatorial interpretation(s) studied). As such they 
are two-variable random elements of said Banach space. The homomorphism densities that 
are used to define convergence are integrals of products of weak-* evaluations of the graphon 
(cf. Definition fTOll . These will be the two-dimensional generalizations of moments that are 
adapted to the added structure of the domain of the graphons. For technical reasons, we shall 
not restrict ourselves to graphons W with domain [0,1]^, but rather more generally consider 
domains that are the product of a probability measure space with itself, 

After one defines a class of objects that is rich enough to capture the whole limit theory, an 
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important question still remains, namely whether the class is too big or not. This was partly 
answered in [2], where it was shown that every graphon is a limit of a sequence of decorated 
graphs. Our aim is to address the remaining part of the question: how much redundancy is 
there in the space of graphons? In other words, given two graphons, under what conditions 
do they represent the same limit? 

The paper follows the approach of |3], building on and refining its ideas and proofs and 
combining them with functional analytic methods related to weak-* integrable functions to 
extend the results to a much more general setting that also includes limits of multigraphs with 
unbounded edge multiplicities. We show that if the generalized moments of a graphon satisfy 
a Carleman-type condition, then, similarly to the one-variable case, the graphon is uniquely 
determined, up to measure preserving transformations of the underlying space vr), see 

(Theorem [TTJ. In particular, bounded Banach space valued graphons are always moment 
determinate. 

However, as for the classical moment problems, one may not forgo some type of bounds on 
the moments to guarantee uniqueness, and using moment indeterminate measures on N, one 
can construct graphons the are not isomorphic in any sense, but have identical generalized 
moments (cf. Section [7]). 


2 Preliminaries 

As mentioned in the introduction, we are interested in functions in two variables taking values 
in a Banach space Z, and a corresponding notion of moments. This involves taking integrals, 
but there is no unique "natural" integral notion in Banach spaces. 

The Bochner, or strong integral, corresponds to integrability "in norm", and is defined as a 
limit of integrals of simple functions. The Pettis integral, or weak integral, uses duality to 
reduce integrability of a 21-valued function to that of real valued ones through weak evalua¬ 
tions. Finally, if Z possesses a predual, weak-* integrability can also be defined in a similar 
way, as shall be done below. Of the three integral notions, weak-* integrability is the weak¬ 
est property (provided it exists), and Bochner integrability the strongest, though some or all 
properties coincide under certain conditions on the Banach space Z (e.g. separability). 

In this paper we are interested in the largest class, that of weak-* integrable functions, as these 
are the ones that arise naturally as limits of multigraph sequences (see [9]). After introducing 
this class of functions and some of its properties, we shall turn our attention to the combi¬ 
natorial structures that allow us to define a notion of moments adapted to the two-variable 
setting and the added geometric structure that comes with it. 

2.1 Weak-* integrable functions 

Let <I> be a separable Banach space, and let Z denote its dual. The elements of <1 act on Z 
as bounded linear functionals in the canonical way. Let further 'L C d> be a countable dense 
subset. 

Definition 1. Let (H,.4,, vr) be a probability space. A function W : (H,.4,, vr) —)■ 2^ is called 
weak-* measurable if for any (/?€<!>, the function {ip,W) is measurable. 

The weak-* measurable function W is called weak-* scalarly integrable, if for any y? G ‘k, the 
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function {ip,W) lies in 

The weak-* measurable function W is called weak-* integrahle (or Gelfand integrable), if there 
exists a mapping ■. Z such that for any A G A and y? G we have 


{ip,W) = 


Remark 2. Note that the standard definition of weak-* measurability only requires that the 
weak-* evaluations be measurable with respect to the completion of the measure vr. In this 
paper, however, we shall need to differentiate between functions that are measurable with 
respect to a measure, and those that are measurable only with respect to its completion. 

Clearly a weak-* integrable function is also weak-* scalarly integrable. The following classi¬ 
cal result shows that the converse is also true. We include its proof for the readers’ conve¬ 
nience. 

Proposition 3. Each weak-* scalarly integrahle function W : (O,^, vr) Z is weak-* inte¬ 
grahle. 


Proof. For a given A ^ A, consider the linear map Wa_ ■ —>■ L^{0,,A,7r) given by Wa{^p) ■= 

1a ■ {p, W). Note that this map has a closed graph. 

Indeed, given any convergent sequence —)■ y? G $ with WA{^n) —^ / G L^{Q,A,7r), we 

can hnd a subsequence such that WA{(pnk) converges almost everywhere to /. But pointwise 
'^A{Pn) converges to and so / = Wa{p) in L^{PI,A,'k). 

Thus by the Closed Graph Theorem Wa is bounded, and so 



< [ \{P.W)\ d-K =\\Wa{^)\\<Wa\\-\\p\\, 
Ja 


which means that the map ip W) dvr is a continuous linear functional on $. Therefore 

there exists a representing element pw{A) G Z^ completing the proof. □ 


The next result shows that the existence of a Radon-Nikodym derivative extends to the setting 
of weak-* integrals, and it is a variant of a theorem due to Rybakov 1 |161 Thm. 2]). In his 
paper Rybakov assumes the underlying measure space to be complete, as the proof makes 
use of lifting on L°°{^,A). In our setting, however, the predual is separable, and therefore 
lifting can be avoided through a different approach, and the assertion holds even when the 
measure space is not complete. 

Proposition 4. Let vr) he a probability space, and suppose that the vector-valued mea¬ 

sure p, : A ^ Z is of a-finite variation, and p tt. Then there exists a weak-* integrable 
function W : Ll ^ Z such that 


{(p,p{A)) = [ {ip,W)d'K 
Ja 

for every y? G $ and A A. 

Proof. First, assume that there exists a c > 0 such that ||i/(^)|| < cp{A), for every A ^ A. 
According to the classical Radon-Nikodym theorem for each y? G 4> there exists a function 
w'^ G A, vr) such that for all A G .A we have 
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w'^p dvr 


Clearly \w'p\ < c\\ip\\ a.e., for each ip separately. In the general case, this is the point where a 
lifting on L°°{Q.,A,'k) would be used to assemble all these derivatives into a single .E-valued 
function. 

Instead, now let 'h' := linQ and consider an enumeration v/>o, v/^i, v/’ 2 ,... of the countable set 
'b', where v/jq = 0. Let us recursively do the following. Let = 0 and := and for 
each n > 2, if is not in the linear hull of the previous V’i-s, then let := w'^^. If on the 

other hand ijjn = YllZi some ai, 02 ,..., On-i S IRj then let := Yl'iZi - Since 

Radon-Nikodym derivation is linear, this is well-defined, and 


{Tpn,K^)) = / dir 
Ja 

for all ^ ^ and 1 < n. Also, this can be linearly extended to all if: £ linjR 'L =: 'L". 

Since 'k' C is countable, there exists a set £ ^ with tt{N) = 0 such that \w^\ < c||v/>|| for 
all 00 £ Q\N and £ 'h', and then by construction actually for all ijj £ 'L". For each uj £ Q\N 
define the functional VF^ : F" —>■ M by 


:= w^iu). 

Clearly RF is linear and bounded by c on F", and hence has a unique bounded extension 
RF) € 2 to Now we can define a function W : (O, .A, vr) -A 2 through 

**'(-)-In”'" 

U otherwise. 


Notice that W is automatically A-measurable, and we have ||R^(a;)|| < c for all a; £ fl. Using 
again that F" = <I>, we may thus conclude that 


{p,p{A)) = f {p,W)dTr 

JA 


for every p ^ ^ and A ^ A. 

To finish the proof in the general case, we need that O can be written as the union of a set 
of measure zero, and sets £ A. (n £ N"*") such that for each n, we have ||/i(A)|| < n7r(A) 
for all An D A £ A.. Since p is of cr-finite variation, the Radon-Nikodym theorem still applies 
to the measures p o p, p £ Define the functions {tp £ T') as above. For n £ N"*", let 


An — 


|w £ D \w^(u})\ < nWipW Vip £ T'l. Then, since T' is countable and generates the norm 
on 2, each A„ is measurable and satisfies ||/r(A)|| < mr^A) for all A„ D A £ A.. It thus only 
remains to be shown that D\ U„gi^+ A„ =: 5 is a set of measure zero. 


Since p is of cr-finite variation, we can write S = U£i with Si £ A, and p being of finite 
variation on each Si. Suppose that there exists an S^ with d := 7r(S'fc) > 0, and let then s be 
the variation of p on Sk, and q := -|- 1. For j > 1, define the sets S^j £ A and S^^ £ A 

through 


S+ := € St 


< ellV'allVl < a < j, and wpt:) > d||*/',|l| , 
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and 


^k,j •= ^ ‘S'fc I^V'a(^)l < ^llV'allVl <a<j, and w^.{uj) < -gll-fAjHj • 

Then ||/^(5'^j)|| > qTr{S^j), and the sets {S^j)j^^+ form a partition of Sk, hence 


s > ^ +'^iSk,j) = Q-^iSk) = qd> s, 


i=i 


i=i 


i=i 


leading to a contradiction. Thus S is the countable union of sets of measure zero, and the 
proof is complete. 

□ 


The following lemma is an easy corollary. 

Lemma 5. Let (O,^,vr) be a probability space, and W : (O,^,vr) Z a weak-* integrable 
function with ||1T|| G L^(7r). Let further A' C A be a sub-a-algebra. Then there exists a weak-* 
integrable function W' : (n,^',7r|^/) —)• Z such that 

{ip,lx{A'))= [ {(p,W)dTT 

■J A' 

for every ip G ^ and A' G A' . If and two such functions, then W[ = W 2 almost 

everywhere with respect to 7r|_4'. 

If for some 1 < p < 00 we have ||VL|| G IP, then also \\W'\\ G IP with ||VL||p > ||bL^||p- 

Proof. Let the vector-valued measure p : A' ^ Z he defined through the weak-* inte¬ 
gral pl{A') := f^, W. Then p is clearly absolutely continuous with respect to 7r|_4/ and 
has (T-finite variation. Hence by Proposition 01 there exists a weak-* integrable function 
W : {LI,A!,'k\_ai) -a- Z satisfying the required equality. If W[ and W 2 are two such func¬ 
tions, then for each if G'^ we have 

{'if,W[) = E{{i^,W)\A!) = {'if,W!2) 

7r|_4/-almost everywhere. Since ^ is countable and separates Z, the assertion follows. 

The inequality between the norms follows from the fact that |((/?, IT(-))| < ||kP(-)|| ' llv^ll) ^ind 
Radon-Nikodym derivation is order-preserving, hence a contraction on every L^ space. □ 

This allows us to extend the notion of conditional expectation to weak-* integrable functions 
with values in Z. 

Definition 6. Let vr) be a probability space, and W : vr) -A Z a, weak-* inte¬ 

grable function. Let further C ^ be a sub-cr-algebra. Then the 7r|_4/-almost everywhere 
unique function W' given in Lemma [5] is called the conditional expectation of W with respect 
to the fj-algebra A' , and will be denoted by E{W \ A'). 

The function W is said to be almost A' -measurable, if VP = E{W \ A') holds 7r-almost every¬ 
where. 

Definition 7. A symmetric function VP : {LI,A,it)‘^ -a Z is called a Z-graphon if it is weak-* 
measurable with respect to the completion ^ x ^ of the underlying a-algebra, and the function 
{x,y) eA- \\W{x,y)\\z lies in := ni<p<oo• ^o^e that this function is 
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measurable with respect to the completed a-algebra, since ‘h is separable, and for a countable 
dense subset 'h C we have 


\\W{x,y)\\z 


sup 


\{f,W{x,y))\ 


Let the space of ^-graphons on (O,^, vr)^ be denoted by y\^{n,A,iT)- We set 

l|W||p := ||||H^(.,.)IU||,. 

(i.e., we take the 2^-norm of W{x,y) for every € [0,1], and then take the L^-norm of the 
resulting function). 

The following notions are related to how "nice" a graphon and the underlying measure space 
are. 

Definition 8. A graphon W G y^(n^A,-K) is called strong if it is also measurable with respect 
to the cr-algebra A x A. 

A graphon W G yV(Q^A,Tr) i® called Lebesguian if the measure space {A, tt) is a standard (or 
Lebesgue) measure space (for a definition of standard probability spaces see e.g. [15[ Section 
2 . 2 ]). 

The graphon W G y^(fi^A,Tr) i® complete if (A, tt) is a complete measure space, and the com¬ 
pletion of a graphon W G y^(n^A,-K) i® the complete graphon W G obtained through 

completing the measure space (^, vr). 

Two points X2_,X2 G fl are called twins with respect to the graphon W G y^(n,A,-K) if W (xi, y) = 
W{x 2 ,y) for almost all y. The graphon W is called almost twin-free if there exists a null-set 
N C such that no two points in Q\N are twins. 

For a ip G ^ and aWG yV(n,A,iT) ict the function ^LF : 12^ —)• M be defined by 

‘^LF(x,y) := ip(W{x,y)). 


Note that we always have ‘^LF G J^{n^A,TT)' 

The following lemma lets us prove weak-* measurability using only a countable dense subset 
of 

Lemma 9. Let 'L C 6e a countable dense subset, and let W : (O, A,tt) ^ Z be a function 
such that is measurable for each if G'^. Then W is weak-* measurable. 


Proof. Since T is countable and dense in <f>, for any tp G ^ there exists a sequence {ipn) C T 
that converges to (p in norm. But then ‘^LF is the pointwise limit of the measurable functions 
’^"VF, and hence itself measurable. □ 


2.2 Decorated graphs and graph densities 

We now turn our attention to decorated graphs, and the "moments" they induce for Banach 
space valued graphons. 

If X is any set, an X-decorated graph is a graph where every edge ij is decorated by an element 
Xij G X. An A-decorated graph will be denoted by (G,g), where G is a simple graph, and 
g: E{G)^X. 
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Definition 10. For a <^-decorated graph F = {F, /) on k vertices and a ^-graphon W, let 
t{F,W):= I n ^^^W{xi,xj)dxi...xk. 

Note that since || 1 F ||2 lies in all spaces for 1 < p < oo, this integral is always finite. 

Our aim is to investigate to what degree graph densities determine a 21-graphon. Just as in 
the real valued case, there is an inherent indeterminacy related to the choice of the underlying 
measure space. We therefore recall some further definitions from measure theory, and from the 
extension of these notions to graphons (cf. [3l Section 2]). Given a graphon W S we 

may obtain a graphon with the exact same graph densities by deleting a null-set from fl. To 
this type of indeterminacy corresponds an equivalence relation between measure spaces. Let 
(fl. A, vr) and (O', A!, vr') be two probability spaces. They are called isomorphic mod 0 if there 
exist null-sets C 0 and N' C O' and a bijection p : Q\N —)• 0'\W such that both p and 
p~^ are measure preserving. The map p itself is called an isomorphism mod 0. 

Another way of obtaining a new graphon with the same graph densities is by applying a 
"pull-back" using a measure preserving map. Let p : (0",^",7r") —>• (0,.4., vr) be a measure 
preserving map. The pull-back W” := {W)^ G of the graphon W G yV(n^A,-K) 

under p is defined through (W)'^{x,y) := W{p{x),p{y)). Then W" again clearly has the same 
graph densities as W . 

Let U G S'lid V G Ai{n2,A2,Tr2) f*® graphons, and suppose that we have a map 

r; : Oi —>• O 2 that is measure preserving from the completion Ai into A2 and satisfies = U 
almost everywhere. Then we say that p is a weak isomorphism from U to V. 

These isomorphism notions can be extended to the graphons themselves. We say that the 
graphons Wi G y^(nx,Ai,-Ki) W2 G Ai{n2,A2,TT2) isomorphic mod 0 if there exists an 
isomorphism mod 0 p : FLi ^ VI2 such that {W2)^ = Wi almost everywhere. As a short-hand 
notation we write VFi = VF 2 . 

We say that LFi and W2 are weakly isomorphic if there exists a graphon LF 3 G VV’(f 23 ^^ 3 ^,r 3 ) and 
weak isomorphisms from each of W\ and W2 into W^. Note that it is not immediately clear 
that being weakly isomorphic is an equivalence relation. 

2.3 Main result 

Using the notations and definitions introduced above, the main result of this paper can be 
formulated as follows. 

Theorem 11. 

(i) Let W G W^n,A,.) and W' G y^^VL^A!y) almost twin-free strong Lehesguian graphons. 

Further assume that the p-norms of W satisfy: 

OO 

n=l 


for all k ^ N"''. Then 


t{F,W) =t{F,W') 


for every ^-deeorated simple graph F if and only ifW and W' are isomorphic mod 0. 

(a) Let W € VV(Q^_ 4 ^ 7 r) o,nd W' G y\i(Q\yi'^Tr') be general graphons. Further assume that the 
p-norms of W satisfy: 


E ii«'ii2'i = “ 

72=1 


for all k G N"''. Then 


t(F,W) = t(F,W') 


for every -decorated simple graph F if and only ifW and W' are weakly isomorphic. 


Here we note that the family of Carleman-type conditions required can be viewed as requiring 
that not only the function/random variable ||VF(-, OH, but all of its powers should satisfy the 
Carleman condition in order to obtain a moment determinacy result. This may seem super¬ 
fluous, but the bounds are actually used for determinacy of new random variables induced by 
partially decorated graphs (see Section [5]). These moments do not correspond to expectations 
of simple powers of the same random variable. In addition, random variables whose moments 
are bounded from above by (or even equal to) the moments of a power of a moment determi¬ 
nate random variable need not be moment determinate themselves, even for the most common 
distributions we know (see, e.g., the papers [2] by Berg, and |10| by Lin and Huang, or the 
monograph m by Stoyanov). 

The above theorem is a generalization of |3l Theorem 2.1], since in the case of bounded real 
valued functions W, the Carleman conditions are automatically satisfied. 


3 Graphon constructions 

To prove the second part of our main theorem, we shall - following Borgs, Chayes and Lovasz [3] 
- be transforming our original graphon by changing the underlying measure space in several 
steps until we end up with a standard Lebesguian space, thereby reducing the problem to 
part (i). This will be achieved mainly through manipulating the corresponding cr-algebra and 
adapting the graphon to these successive changes. We therefore briefly recall the necessary 
notions from measure theory. 

A set iS of subsets of 12 induces a partition V[S] of 12 through the natural equivalence relation 
wi ~ a ;2 [VS' € S : (wi G S f\ LjJ2 G S) M (wi 0 S A W 2 0 S)]. This is the finest partition for 
which S separates the classes. A graphon W G is said to be separating if A separates 

12, or in other words if W = W/V[A]. 

A cr-algebra A is said to be countably generated if there is a countable set S d A such that 
the generated cr-algebra satisfies cr(S) = A. A set S C Vl is said to be a basis of the measure 
space (12,.4,, tt) if <j{S) is dense in A, that is, if for every Ai G A there exists an A 2 G cr(S') 
such that 7r(AiAA2) = 0. A graphon W G 'fV(Q^A,TT) i® s^-id to be countably generated if A 
itself is. 

A probability space (12',.A^7r') is said to be a full subspace of the probability space (12, Vl, vr) 
if 12' C 12 has outer measure 1 (it need not be measurable) and (A', vr') is the restriction of 
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{A, vr) to O', i.e., = {^4 n 0'|^ € A} and 7r'[A D O') = 'it{A) for all A £ A. 

A measure preserving map /r : (0, A, tt) —)• (O', A', vr') between two probability spaces is called 
an embedding of (O, A, vr) into (O', ^'vr') if it is an isomorphism between the former and a 
full subspace of the latter. Given two graphons W € yV(n^A,iT) ^i^cl W G the 

embedding /r is said to be an embedding of W into W' if in addition (W')^ = W almost 
everywhere. 

Let us start with the following Lemma, that allows us to change the cr-algebra we work with 
to a countably generated one one, without losing measurability. 

Lemma 12. Let (0,.4.) and (O',^') be measurable spaces, and let W : LI x LI' ^ Z be a 
weak-* measurable function with respect to the a-algebra (.4. x A!). Then there exist countably 
generated a-algebras Aq C A and A!q Cl A! such that W is weak-* measurable with respect to 
(»4o X .Aq). 

Proof. Choose a dense countable subset ^ C 4>. For each if £ ^ we can find countable sets 
C 4. and S'^ C Af such that -0 o IF is measurable w.r.t. the generated cr-algebra (cf. 
[31 Lemma 3.4], boundedness is actually not needed, since we can compose with the arctan 
function to reduce to the bounded case). Thus taking Aq and A!q to be the sub-cr-algebras 
generated by {S.,p)^£q/ and respectively. Lemma [9] ensures the required measurability 

of IF. □ 

Next we shall introduce two further constructions that given a graphon allow us to create a 
new graphon, preserving some of its essential properties. 

Remark 13. For ease of notation, using Proposition HI the integrals we write from here on 
are to be understood in the weak-* sense rather than the strong/Bochner sense. 

Lemma 14. Let (11,4., vr) and (n',4',vr') be probability spaces, let t : LI ^ LI' be a measure 
preserving map, and let W £ 

(i) There exists a strong graphon W' £ yV(Q'^ tt') that satisfies 

[ Wr{x',y')d7r'{x')d7:'{y') = [ W{x,y)d7r{x)dTr{y) (1) 

Ja{xA'^ Jr-PA[)XT-PA'^) 

for all A'i,A '2 £ A!. 

(a) If T is an embedding, then (WrY = ^ almost everywhere. 


Proof. First let 4(- := r ^(4') C 4 and define W := E{W\A!j. x 4(-). Also let vr^- := vr|_ 4 ^ 
Then define a measure /r on 4(- x 4(- through 

/r( 4 i X 42) = / W{x,y)d'K{x)d'K{y) 

JA.\ X A2 


for all 4 i, 42 £ 4(-. Since ||1F|| lies in L^, we have that /r <C vr x vr. Let yj- be the push- 
forward of /r. Since cp is measure-preserving, ju^ is a 2^-valued measure on A! that is absolutely 
continuous with respect to vr' x vr'. 

By Lemma [5l there exists a weak-* integrable function WV : LI' x LI' ^ Z such that for all 
4;,4'2 g4', 

y{A'^ X A'2) = [ W'{x,y)dTT'{x)dTT'{y). 

J A', xAi 
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This W' then clearly satisfies equation [H and since the push-forward n' of the symmetric 
measure /U is itself symmetric, it follows that W is too. By the norm inequality in Lemma El 
we actually have that W' € completing the proof of part (i). 

By construction {WrY = W = E(W\A'^ x A'Y, so part (ii) follows from the definition of 

AY □ 

Definition 15. The function Wr dehned in[T3]is called the push-forward of W under r. 

Given a graphon W € y^(n^A,-K) a partition V of id, we can use the push-forward con¬ 
struction to define the factor graphon W/V of W under V. Consider the surjection /i : w i—>■ 
[cj] from to fl/T*, where [w] denotes the partition class of uj. Define the measure space 
{QfV,Af'P,Trf'P) as the push-forward of (D,^, tt) under fi. Then /i is automatically measure 
preserving, and we let W/V := G W’(o/p,^/-p, 7 r/p)- 

Note that push-forwards being a type of conditional expectations, the moments of a graphon 
are usually not preserved. However, if the underlying measure space is carefully manipulated, 
this problem can be avoided, as illustrated by the next theorem, which sums up the different 
steps that will allow us to pass from part (i) to part (ii) of Theorem [11] 

Theorem 16. Let W G W(o,yt, 7 r) be a graphon. 

(i) One can change the value of W on a set of tt x n-measure 0 to get a strong Zi-valued 
graphon. 

(ii) Suppose that W is a strong graphon. Then there exists a countably generated a-algebra 
A! Cl A such that W is weak-* measurable with respect to [A! x A'). 

(Hi) The graphon W/V\A\ is separating. IfW is countably generated, then so is W/V[A]. 

(iv) Suppose that W is a separating graphon on a probability space with a countable basis. 
Then the completion of W can be embedded in a Lebesguian graphon. 

(v) Suppose that W is a strong graphon, and let V he the partition into the twin-classes of 
W. Then W/V is almost twin-free. IfW is Lebesguian, then W/V is Lebesguian as well. 
Furthermore the projection W —>■ W/V is a weak isomorphism. 

For part (i), consider the conditional expectation W' := E{W\AxA). Since W and the 
underlying u-algebra both are symmetric, we may assume that so is W'. By construction, W' 
is measurable with respect to ^ x so it is enough to show that W = W' almost everywhere. 
To this end note that ~ ~ ^ ^i )^2 CL A, and therefore also for all 

5 G .4 X ^ we have fg(W' — VF) = 0, implying W' — W = 0 almost everywhere. 

Part (ii) is an easy consequence of Lemma [T2| 

For part (iii), note that by identifying elements in the came class of the partition P[4.], we 
obtain a cr-algebra that is isomorphic to A under the natural map. 

For part (iv), let 5 be a countable set generating A. Since any separating complete probability 
space with a countable basis can be embedded into a Lebesgue space (see e.g. |151 Section 2.2]) 
and 5 is a countable basis for {A, If), there exists an embedding r] : (D,4,, If) —>■ [LI', A', 11 ') 
where [LI',A','k') is a Lebesgue space. Consider the push-forward W' := Wr^. By Lemma 
fm iiL the mapping 77 is an embedding of the completion W of W into the Lebesguian graphon 
W'. 


11 



For part (v), we may by part (ii) assume that A is countably generated, since the relation of 
being twins is the same for any underlying cr-algebra B x B that leaves W weak*-measurable 
(and hence weak-* integrable). Let A-p denote the sub-cr-algebra of A consisting of the sets 
that do not separate any pair of twins. Note that by the construction in Lemma [TU we then 
have that (W/Vy = E{W\A'p x Ap) G - Thus the projection W — >■ W/V is a weak 

isomorphism if LF = E(W\Ap x Ap) almost everywhere. 

Let W := E{W\Ap x Ap). Since 'L C is countable and dense, hence separates elements in 
Z, it is sufficient to show that for any A,B(^A and G 'L we have 

f '^W {x,y)d'n{x)d'n{y) = f {x^y)d'n{x)d'n{y). 

JAxB JAxB 


This, and the fact that W/V is twin-free, can easily be proven, and we refer to O Section 
3.3.5] for the details. 


We now wish to show that W/V is Lebesguian under the assumption that W itself is. By |151 
Section 3.2] the measure space [Q/V, A/V ,11 /V) is a Lebesgue space if there exists a countable 
set <S C that separates points if and only if they are from different partition classes. Let T 
be a countable set generating A, closed under finite intersections. For each A ^ A and x G n, 
let 

yx{A)= / W{x,y)d7r{y). 

Ja 


Since W is weak-* integrable with respect to A x A, the mapping A 1 —> yLx{A) is a .Z-valued 
measure for all x G 12, and x 1 —)■ p-xiA) is an Fl- measurable function on n for each A ^ A. 
Note that then x,x' are twins if and only if Px{A) = px'iA) for all A ^ A, and since each 
measure Pxi') is uniquely determined by the values taken on T, x and x' are twins if and only 
if pxiT) = yx'{T) for all T G T. 


Let 'L C be a countable dense set, and for every ip (z ^, T T and rational number r let 
Sii)^T,r := {x G n : ^{yxiT)) Pi These are countably many and clearly do not separate 
twins. If however x and x' are not twins, then for some T £ T we have yx{T) 7 ^ d-x'{T). Since 
'L separates Z, we can then find •0 G T and r G Q such that S^^T,r separates x and x'. 
Corollary 17. Every graphon W G Vy(n,^,7r) has a weak isomorphism into an almost twin-free 


strong Lebesguian Z-valued graphon W. In addition 


W 


for all 1 < p < 00 . 


Proof. First let us change the graphon W G ^ null-set to obtain a strong graphon 

Wi applying (i) of the previous theorem. Then the identity map on the underlying probability 
space (12, A, n) will be a Fl — Fl-measurable weak isomorphism ri from W to LFi. Now by points 
(ii)-(iv) the completion of the graphon LFi has an embedding T 2 into a Lebesguian graphon 
VF 3 , which in turn by point (v) can be projected onto its almost twin-free Lebesguian form 
W G through a weak isomorphism T 3 . Since the composition r := ra o r 2 o n is a 

A — ^-measurable mapping between (12,^, tt) and the Lebesgue space (12,Fl, T), it is indeed 
a weak isomorphism from W into W. Concerning the last assertion, note that none of the 
transformations in the previous theorem actually changed the norm of the graphon. 

□ 
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4 Anchored graphons 


As mentioned in the introduction, two-variables functions on a product measure space 0x0 
lack a canonical form, or a canonical reordering of the underlying product space. To counter 
this, Borgs, Chayes and Lovasz made in [3] use of countable sequences of random elements of O 
and defined what they called canonical ensembles. In essence this means that instead of having 
a single well-defined canonical form, one rather has a whole family of functions, together with 
a probability measure on said family. This pair contains all the relevant information on the 
original function, and is easier to handle than the original single function. In addition these 
new functions all live on the same cr-algebra, independently of the measure space of the original 
graphon, making it possible to compare these random representations. 

First we shall need a few results that guarantee that with probability 1, the randomness we 
wish to introduce does not interfere with measurability. 

Lemma 18. Let (0,4., vr) and (O', A,7r') be probability spaces, and letW : O x O' — >■ .Z be a 
weak-* measurable function with respect to Ax A' such that ||IT|| G L^(0 x O'). Let further 
Yi,Y 2 , ... be independent random points from O', and Aq C A the random a-algebra generated 
by the funetions W{-,Yi:). Then with probability 1, W is almost weak-* measurable with respect 
to AqX A!. 


Proof. By Lemma [T2l we may assume that both A and A! are countably generated. Let 
4i (G ^4-2 CZ ... and (Z ^^2 ■ ■ ■ be sequences of finite u—algebras such that fT(LJ^./dy,^) — 

and (T(\JriA!„) = A', and let P' denote the partition of 0' into the atoms of A!„. For each 
y^S^Pl, with 7r'(S) > 0 let 


Un,m{A, y') 


1 

rmrfS) 


Y,W{x,Yj), 

j<m 

YjGS 


whilst Un,m{x,y) := 0 whenever 7r'(5) = 0. Let T C $ be a countable dense subset of the 
predual of Z. 

We first wish to prove that for every G n > 1, every A G AnAn and A' G A'^ we have 
with probability 1 that 


^ d-Kd-n' 


lAxA' 


^Wd-Kd-n'. 


lAxA' 


( 2 ) 


Since A'^ is atomic, it is enough to show this for sets A' = S ^ P^ with > 0. For every 

yo G S we then have 

[ {x,yQ) d-K{x) = - j ^W{x,Yj)d-K{x). 

YjGS 


Since ||IT|| lies in L^ C L^, the function lies in L^, hence we may apply the Law of Large 
Numbers to obtain 


L 




i{x,yo)dTT{x) 


TTfS) 


^Wd-KdTi'. 


'AxS 
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Since both sides are independent of the choice of yo £ S, we may integrate it out over S to 
obtain equation Q. 


We have a countable number of choices for G n € N"*", A' G A! and A G hence 

with probability 1 equation ([2]) holds for all V’ £ 'h, all re G N"*", A’ G A!^ and A G VJkAk- Also, 
note that 


\\Un,m{x, y) II < 


1 

rmr'{S) 


j<m 

YjGS 


whence by AM-QM, 


\\Un,m{x,y)f < 


1 

m7r'{Sy 


j<m 

Yj&S 


For each yo € S ^ with Tr'{S) > 0 we then have 


/ 

Jn 


\\Un,m{x,yo)f dn^x) < 


1 1 


7r'(5)2 


rre 


E 

j<m ‘ 

YiGS 


\\W{x,Yj)fd7r{x). 


(3) 


Again inequality ([3]) is independent of the choice of j/o £ S, so we may integrate over it to 
obtain 


/ \\Un,m{x,yo)f d7r{x)dTT'{yo) < 
jQxS 



Since by assumption ||PF|| lies in we may again apply the Law of Large Numbers to the 
right hand side to obtain that with probability 1 


1 1 
7r'(5) rre 



PiS) 


'nxs 


||iy||^d7r(i7r' < oo. 


Since there are finitely many S (z with vr'(5) > 0, summing over all such S yields that with 
probability 1, the sequence (L^n,m)meN+ is uniformly bounded in L^-norm for each re G N'*'. 

From now on assume that the choice of the Yj is such that equation ([2]) holds for all r/; G all 
re G N"*", Al G Al^ and A G UnAn, and that the sequence {Un,m)m,&+ is uniformly bounded in 
L^-norm for each re G N"*". For a fixed re, by compactness and since there are countably many 
elements in we may by a diagonal argument choose a subsequence {mk)k&i+ C N"*" such 
that for each ijj £ "if the sequence {^Un,mk)k£n+ converges weakly in Lp‘{A x Denote 

the weak limits by Un^ip- Since by construction each ^Un,rrn. is ^ ^^-measurable, the same 
is true for the weak limits Un,ij)- 

By equation Q we have that for each re > 1 and r/i G dr, 


! AxA' 


Un,^ij dirdP 


lim [ d-Kdir' = f '^W dirdn 

k^ooJAxA' ’ JaxA' 


I AxA' 


E{^W\A X A'JdndTT' 
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for all A G UnAn and A! G But both functions and E{'^W\A x A'^) lie in Lp‘{A x 
and since ^nAn is dense in A, the above equality is in fact true for all A ^ A. This 
means that the functions Un,-ti) and E^^WlA X A^) represent the same element in L‘^{A x 
Since ^^-measurable, this in turn means that for every G T 

E{^W\AoxA'J = E{^W\AxA'J (4) 

in L'^{A X By Levy’s Upward Theorem, however, the left hand side of (jH) tends a.e. 

to E{'^W\Ao X A') as n ^ oo, whilst the right hand side tends a.e. to E{'^W\A x A). Thus 
for each ^ G T we have that 

E{'t’W\Ao X A) = E{^W\A X A) = 

in L‘^{A X meaning that is almost ^Lnieasurable for all ■0 G T. By Lemma 

E and since T is countable, it then follows that W is almost weak-* measurable with respect 
to ^ X A. 


□ 


The following is an immediate consequence of the previous theorem. 

Corollary 19. Let (U,^, vr) and [A,A,7 ^') he probability spaces, and letW : LI x A ^ Z be 
a weak-* measurable function with respect to Ax A with ||VU|| G L^. Let further C A be 
a sub-a-algebra. IfW{-,y) is weak-* measurable with respect to A for almost all x (z LI, then 
W is almost weak-* measurable with respect to Aq x A. 

Applying the previous corollary twice, we obtain the following result, which is the key element 
in our randomization. 

Corollary 20. Let W G ^6 a strong graphon, and let Xi,X 2 ,... be independent ran¬ 

dom points from LI. Let Aq G A be the random a-algebra generated by the functions W{-,Xi,,), 
k G N^. Then with probability 1, W is almost weak-* measurable with respect to ^0- 

Proof. The proof of [3l Corollary 4.3] works also in this more general setting, with minor 
natural modifications. □ 

Let now W G be a strong graphon and a = (oi, a 2 ,...) an infinite sequence of points 

in LI. Consider the map x rQ,(a:) defined by 

r„(x) := {{^W{x, i'^Wix, a 2 ))v,G^,...) G =: TZ. (5) 

Since each '^W (• ,aj) is measurable by assumption, Tq, is a measurable map from fl into TZ 
with respect to the standard Borel cj-algebra /C on the product space, and thereby defines a 
push-forward measure Kq on /C through 

Ac„(5) = 7r(r-i(5)), (6) 

for S' G /C. Denote by C the completion of K, with respect to and Aq the extension of 
to C. 

Let further VLr^ be the push-forward of W under Tq, and denote by Wa G its 

completion. 
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Definition 21 . The graphon Wa is called the anchored graphon with respect to the anchor 
sequence a. An anchor sequence a is called regular if W = almost everywhere. 

Remark 22 . Since it is the product of countably many copies of M, TZ itself is a complete 
Polish space, hence Wa is always a Lebesguian graphon. 

Lemma 23 . Almost all a € are regular. 

Proof. Let Aa denote the pullback of the cr-algebra K, under the map Pq. Since Pq is mea¬ 
surable, we have Aa C A. Also, by construction Aa is the smallest cr-algebra such that all 
of the functions ('0 £ ik, 1 < j) are measurable. We may thus apply Lemma [TBl to 

obtain that for almost all a, W is almost weak-* measurable with respect to Aa X Aa- But by 
the construction given in the proof of Lemma [TT] it immediately follows that W = (VFra)^“ 
a.e.. □ 

5 Densities and coupling of anchored graphons 

Now that we have introduced random canonical forms for graphons, our aim is to show that 
on the one hand two weakly isomorphic graphons have essentially the same random canonical 
form, and on the other hand that this random canonical form is determined by the moment 
functions. The main helping tool here are densities stemming from so-called partially labeled 
graphs. These provide the necessary randomness that will act as a bridge between the usual 
deterministic densities and the random anchored graphons, and allow us to find appropriate 
couplings between the anchors. We present the necessary notions and properties necessary in 
the context of decorated graphs, and refer to HU for futher properties and applications of 
partial labeling. 

Let F = (F, f) be a decorated graph. A partial labeling of F is an injective map from a subset 
of the vertices of F into the set of positive integers. If the injective map has as image the 
set {1,2,..., A;}, the partially labeled decorated graph is called k-labeled. To simplify notation, 
the case k = 0 corresponds to unlabeled decorated graphs. 

Two partially labeled decorated graphs Fi and F 2 are isomorphic if there exists a graph 
isomorphism between Fi and F2 that preserves both the labels and the decorations. The 
product F 1 F 2 of two partially labeled decorated graphs Fi and F 2 is itself a partially labeled 
decorated graph, defined as follows: take the disjoint union of Fi and F2, then merge the 
vertices that have identical labels, whilst keeping the labels and decorations as well as any 
multiple edges that may arise. 

Next, we define marginals induced by partial labelings. Supose F = (F, /) is a partially 
labeled <f>-decorated graph with vertex set V(F) = {ui,..., Vk}, where the vertices vi,... ,Vr 
are labeled by the positive integers ii,... ,ir, and the remaining vertices are unlabeled. Given 
a graphon W € y^{p„A,-K) and an infinite sequence /3 = (/3i,/32 ,...) in 12, for 1 < j < r set 
Xj := and let X^+i, ■ ■ ■ ,Xk be independent random points of 12 from the distribution vr. 
Then we may define the marginal 


tg{F,W) :=E 




yViVjeE{F) 
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This marginal only depends on the finitely many elements of /3 whose index appears as label, 
so it will be convenient to sometimes omit the tail of /3 containing no labels. 

If Fi and F 2 are two fc-labeled graphs, it can easily be seen that 

t(FiF2) = [ txi...Xk{Fl,W)txi...Xk(P2,W)d7T{xi) . . .dTT{Xk). 

We shall show how anchor sequences can be used to prove almost everywhere equality of 
appropriate graphons. Having to involve densities of labeled multigmphs is a technical necessity 
of the approach introduced in [3], as we wish to prove equality of measures through equality 
of moments, and higher mixed moments in this context naturally correspond to densities of 
multigraphs rather than those of simple graphs. As we shall later see, this is not going to be 
a hindrance. 

Given a countably generated dense subspace T G <I> of decorations, let denote the set 
of /c-labeled T-decorated multigraphs with no edge between labeled vertices, and let T* := 
Un=oJ^l ■ 

Lemma 24. Let W G yV{n,A,'K) ^ ^(r2',.4',7r') be two strong graphons, and let a and 

fd he regular anehor sequences in Ll for W and LI' for W', respectively. Suppose that for every 
partially labeled ^-decorated multigraph F G J-*, we have 

ta{F,W)=mF,W'). 

Further suppose that for some eountable dense subset T C $ the p-norms of W and of its 
aj-seetions satisfy: 


00 00 

^||^W(A,a,)ll 2 -n =00 and ||-i = 00 (7) 

n=l n=l 

for all j G N"*" and ^ G T. Then the anehored graphons Wa G ^ 

satisfy Aq, = and Wa = W'^ almost everywhere with respect to the common measure. 

Proof. Let us first show that Aq = X'j^. Recall that Aq is the distribution measure of the 
random variable vector ...), where X G Id is a random 

point with distribution vr, whilst Aq is the distribution measure of the random variable sequence 

...), where Y € LI' is a random point with distribution tt'. 

Each of these random variables is real-valued, and we shall first show that their mixed mo¬ 
ments are all equal. Let therefore (A:n,i/')nGN+,V'6'l' t>e a double-indexed sequence of nonnegative 
integers, with only finitely many non-zero elements. Let m G N+ be such that = 0 for all 
n > m, and construct the partially labeled di-decorated multigraph F G J-* on m -|- 1 vertices 
as follows. First label all but one vertex with the help of the labels 1,... ,m. Then for each 
1 < j < m and ^ G T consider the vertex j and the unlabeled vertex, and add edges 
decorated by if between them. Then by construction 

F H ^W{X,an)’^-A =ta{F,W). 

\neN+,-!/'e^' / 
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Similarly 


\nGN+,'i/ie'I' / 

These two are by assumption equal, so all mixed moments are indeed the same. If these were 
all bounded variables, it would immediately follow that they are equal, as the mixed moments 
would uniquely determine their joint distribution. In the unbounded case, however, we need 
an extra property to guarantee uniqueness. By [51 Cor. 3a], it is enough that the variables 
pertaining to W each separately satisfy the Carleman condition, i.e., the family of conditions 
ijT]). Hence Aq = 

Now we proceed to show that Wa{x, y) = W'p{x, y) almost everywhere. To this end we wish to 
show that the random variables Ui = {X,Y,Wa{X,Y)) and U 2 = (X, T, IT^(X, T)) have the 
same distribution, where X and Y are independent random points in (7^, A^). By definition 
of the distributions on [TZ, A^) we can generate X and Y by taking the random independent 
points X\Y' from (n,7r) and letting X := rQ(X') and Y := r„(y'). Since a is regular for 
IT, we have with probability 1 that Wa{X,Y) = W{X',Y'), and hence 

Ui = ((^iy(X',ai))^6^,(^iy(X',a2)W,..., 

{^W{Y', {^W{Y'a2))^e^, ..., 

W{X\Y')). 

For W' we correspondingly take X” and Y" from (fl', tt') instead, and obtain with probability 
1 that 


U 2 = ((^IF'(X", i^W'iX", P2)U^^, ..., 

(^iy'(y",/?i))v,evp, {^w'{Y"p2))i,^^, ..., 

W'{X\Y")). 

To compare these two vectors, however, we have to replace their last coordinate with a sequence 
of real-valued variables with the help of the elements of 

Let therefore 

Ui := ((^iy(X',ai))v,g^,(^iy(X',a2)VGvi-,..., 

(^IT(y', {^W{Y’a2))^^^. • • •, 

(^iy(x',y')W) 


and 

(^iy'(y", {'f’w'{Y"f52))^^^., ..., 

(^iy'(x",y"))v.G^)- 

Each mixed moment is determined by nonnegative integers (on,i/j)nGN+,f/'6’l') (^n,V')neN+,V>e'l' 
and such that only a hnite number of them is non-zero. Assume for instance that 
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o-n,tl) = ^n,f/> = 0 all n > m for some appropriate integer m. Let us define a partially labeled 
'L-decorated multigraph F G IF* on m + 2 vertices as follows. First label all but two vertices 
with the labels 1, ... ,m, and denote the remaining two by Vx and Vy. Then for each i/; G T 
add parallel edges between Vx and Vy, decorating them with Finally for each 1 < n < m 
and ^ G T add 0 ^, 1 /) parallel edges decorated with ijj between Vx and the vertex with label n, 
and parallel edges decorated with ^ between Vy and the vertex with label n. Then we 
have 


and 


\nGN+,'i/iG5' 

= UF,W), 




ne^N+,'ipG'S/ V’G'I' 


F Yl ■ n ■ Yl^W'{X'',Y''y* 


i^nGN+.V’G'I' 

= tp{F,W'), 


nGN+iV'G'I' 


ipG'i/ 


which are by assumption equal, and using the conditions in ([7|), we are done. □ 

Remark 25. Note that in condition (ED, the second part implies the first for almost all 
sequences a. Indeed, for 0 < c let Sc C 12 be the set of points ?/ G 12 such that 


n=l 

Suppose that 7r(Sc) > 0. We then for n > 1 have by the Holder inequality that 

W^Whn > 


> 


> 


'Sc \jn 

1 


2n \ \ 1/2^ 

'^W{x,y) dn^x)] dTT{y) 


, 2n \ 

^W{x,y) d7r(x) I dir^y) 


7r(Sc)^ V2n 

1 f / f : 2n \ 

J '^W{x,y) d7 r(x)] d7r(y) 


vr(Sc)V2 
1 


7r(Sc)^/2 


/ "^Wyy) d 7 r(y). 
JSc 2n 


Thus by convexity 


< 




lywhn - Jsc\\'^W{;y)\\^^d7T{y) 


< 
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and so for all G N 


N 


E 

n=l 


1 

¥^n 


,_ N r 

< ^/tt{Sc) ^ / 
^_1 J s 


1 


n=l 

N 


/ E 

n=l 


\\^Wi;y)\\,^ 

1 


ll^^(•,y)ll 


d7r{y) 

d'K{y) 


2n 


< c^/^^{Scy 


leading to a contradiction. But if ^{Sc) = 0 for all c = 0, then the sum 

OO 

n=l 

is infinite for almost all y G fl, and therefore also for almost every infinite sequence a. 

Our next lemma shows that under a Carleman-type set of conditions, equality of multigraph 
homomorphism densities, the random canonical forms can be coupled in such a way as to have 
the corresponding marginals all equal. 

The reason for us not wanting to have edges between labeled vertices in the test-graphs involved 
in the coupling is that their absence significantly simplifies and improves the upper bounds on 
the mixed moments, and thus weaker Carleman-type conditions will suffice. Luckily this is not 
a restriction here, as the multigraph constructions arising from the mixed moments preserve 
this property. 

Lemma 26 . Let W G yV(n^A,TT) two strong Lebesguian graphons such 

that 

t{F,W) =t{F,W') 

for every unlabeled -decorated multigraph F. Further suppose that the p-norms ofW satisfy 
the Carleman type conditions: 


n=l 

for all k G N"*". Then we can couple sequences a G 0^"*" with sequences ft G such that if 
(a, /3) is taken from the joint distribution, then with probability 1 

t^{F,W) = tg{F,W') 

for every partially labeled -decorated multigraph F G J-*. 

Proof. We shall recursively define a coupling of sequences 7 G and 5 G such that almost 
surely we for all F G J 7 have that f-),(F, W) = ts{F, W). This is trivial to do for /c = 0. Let 
us now assume we have such a coupling for sequences of length k, and let ( 71 ,... , 7 ^,) and 
((5i,..., 6 k) be chosen from this coupled distribution. Let further X be a random point from 
(ff, 7 r), and Y a random point from {Q',7r'), and define the random variables 
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and 


with values in Our aim is to show that they have the same distribution. 

To prove that the joint distributions are equal, we first show that their mixed moments coin¬ 
cide, and then prove that the coordinates of C satisfy the Carleman condition. 

Let m € N"*", Fi,...,F^ S ^k+i^ Qi, ■ ■ ■ jQm be non-negative integers. Then for 1 < 

j < m define F^^ € -^k+i ^be gj-fold product of Fj with itself. Let further F £ be 
defined as the product F^^ ... F^ with label k + 1 removed from the corresponding vertex. 
Then we have that the corresponding moment of C satisfies 


E 


|^ni 7 i... 7 .x(F,,lTr^j 


E (t^,..^,x(Ff ... F^-, IT)) = (F, IT). 


Similar arguments yield that the corresponding mixed moment of D is f, 5 j... 5 j,(F, PT'), which 
by hypothesis is the same. 

We now have to show that each coordinate of C satisfies the Carleman condition. Let 9 
F = (E, f) and consider Cf{X) := ^W). Since E does not have any edges between 

labeled vertices, we have 


\V(F)\ /mult(j;fc+it;a) 


Cf(X) = 


n 

a=k-\-2 


|y(F)| / mu\t{vaVi,) 

WiX,Xa) inn (^Xa, Xb) 

i=l j a,b=k-\-2 \ i=l 


n 




n 


l<j<k 

k+2<a<\V{F)\ 


' mxAt(vjVa) 

■^(’'>’'“blT(7j,Xa) j dXk+2-■ ■dx\v(F)\ 

i=\ 


For almost all anchor sequences 7 we have that W('yj,x)dx is finite for all j. By the Holder 

inequality (using that 7 r(f 7 ) = 1 ) we thus have 


|y(F)| mult(Dfe + iDa) 

\cf{x)\<^ n n 

a=k+2 i=l 


||lT(X,Xa)||l®(^)l dx. 


\E(F)\ 


where is a finite constant depending on IT, F and 71 ,..., 7 ^. Consequently, by further 
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applications of Holder’s inequality we have 

\V{F)\ 


IIC'fI 


n < 


L n n (X 


'a=k+2 
|y(F)| mult('Ufc+iiJa) 

s *” n n 

a=k-\-2 i=\ 

|y(F)| mult(Di. + iDa) 

= *”11 n 

a=k-\-2 i=l 
|y(F)| mult(Di: + i'!)a) 

<«- n n 

a=k+2 i=l 
|y(F)| mult(Di: + i'!)a) 

= *”11 n 

a=k-\-2 i=l 

Therefore with K := \E{F)\ we have 


||1T(X,X„)||I®(^)I dXa)^ dX 




O \JQ 


n\E(F)\ 

\E{F)\ 


|£;(F)| 


dX 


n \Jn 


\\W{X,Xa)\\^^^^^^ dXa] dX 


|B(F)| 


Q Jfl 


\\W{X,Xa)r'^^^^' dXadX 


|F(F)| 


;i£,F,i < *■" iiirii:!?!?!! 


OO - oo 


2iTJi — 


n=l n=l 

and so the Carleman condition is indeed satisfied. 

Thus C and D have the same distribution, and by [3l Lemma 6.2] we can then couple X and 
Y so that with probability 1 we have C = D. Thus there exist random variables X' from 
(H,7r) and Y' from such that the joint distribution of {X\Y') G satisfies with 

probability 1 that 

for every F G Xk+i- This extends our coupling to one between and Iterating, we 

obtain the desired coupling between and . □ 


Our final lemma is to show that graphons having equal simple graph densities also have equal 
multigraph densities, and hence no generality was lost in the assumptions of the previous 
results. Note that labeled graphs play in the below proof a different role than above, and as 
such it is not an issue that we here allow (multiple) edges between labeled vertices. 

Lemma 27. Let Wi G y^{ni,Ai,TT-i_) andW 2 G W(02,.42,^2) countably generated graphons, 

and assume that t(F, ITi) = t(F, W 2 ) for every simple ^-deeorated graph F. Then t(F, Wi) = 
t(F,lT 2 ) for every ^-deeorated multigraph F = {F,f). 

Proof. We shall proceed by induction on the number of parallel edges in F. The base case is 
given by the assumption. Let Vi and Vj be two vertices connected by more than one edge, and 
let G be the decoration on one of them. Denote by F' the decorated multigraph obtained 
by deleting one (/^-decorated edge between Vi and vj. Let further F^ denote the decorated 
multigraph obtained by adding a path of length k between Vi and Vj in F', decorating each 
edge in the path with (p. Thus F^ = F, but for each A: > 1 the multigraph F^ has fewer 
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parallel edges than F. Hence by the inductive assumption we have that t(F^, Wi) = t(F^, W 2 ) 
for each k > 1. Let us now label all the multigraphs F^ and F' such that Vi receives the label 
1 whilst Vj receives the label 2. Then F*^ is the product of F' with the path Pfc+i of length 
(A: + 1) with its two endpoints labeled 1 and 2 respectively and each edge decorated with tp, 
and we may write 


and 


Note that 


t(F,Wi)= [ W{x,y%y{F',Wi)d7ri{x)d7ri{y), 
t{F\Wi)= [ t^y{Pk+uW%y{F',Wi)d7ri{x)d7T^{y). 

ta;y(Pk+i,W) = [ ‘^W{x,xi)---‘^W{xk-i,y)dTT{xi)...d7r{xk-i). 


Since G L^(n|,R), it is a self-adjoint Hilbert-Schmidt integral operator on L^(12i,C), 
and thus has a spectral decomposition 


‘^LFi(x,y)= ^ K,mCn(x}Cm(y) 

n,m=l 

in the sense, where (Cn) is an orthonormal system in L^(ni,C). 

Then we obtain by induction on k that for every A: > 1, 

00 

t,y(Pk+i,Wi)= \l^^Ux)U(y) 

n,m=0 

in whereby 

00 « 

t{F\Wi)= V / Qn{x)Qm{y%y{F\Wi)d'Ki{x)dT^^{y), 

n^=l 


since txy(F', Wi) lies in by the assumption on Wi. 

Similarly, with the spectral decomposition 

CXD 

‘^W2{x,y) = yn,mTln{x)ym{y), 

n,m=l 


we obtain 

00 

0 = ^(F^lFl)-^(F^fF2)= an,mXim-bn,mkiim 

n,m=l 

for every k >2, where the parameters 


0-n,m ■— / C'nix')(^jn(jj')txy(F , Hi jdTTi (y) 

Jnl 


( 8 ) 
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and 


h 


n,m • — 



'nn{x)-qrn{y)txy{^' ,W2)d'K2{x)d'K2{y) 


are independent of k. 


Since each non-zero eigenvalue has finite multiplicity and the only possible accumulation point 
is 0, the asymptotic behaviour of the right hand side in ([8]) dictates that all the terms have 
to cancel, i.e., for each c G IK\{0} we have that 


E 

^n.m —C 




E ^ 


Then 


OO « OO 

t{F,Wi) = E ^n,7n / Cnix)Cm{y)txy{F',Wi)dTri{x)d7ri{y) = E 

n,m=l ^ n,m=l 

similarly 

OO 

t{F^W2) — ^ ^ 

n,m=l 

and the claim follows. □ 

Remark 28. By Lemma fT2l countable generation is not actually needed. 


6 Proof of main theorem 

Having extended the intermediate steps of [3] to the significantly more general context of our 
investigations, we are now ready to bring together the elements of the previous sections to 
prove our main result. 

Proof of Theorem \11\ Part (i): By Lemma [271 equality of simple graph densities implies 
equality of multigraph densities, and thus we may apply Lemma [261 to our two graphons. If 
we choose the anchor sequences a G 12^^ and (3 G from the joint distribution given by 

Lemma (TUI almost all such choices satisfy 

ta(F,W)=tfl(F,W') 

for every partially labeled T-decorated multigraph F G P*, and but for a further null-set they 
yield anchor sequences that are regular fLemma I23p . Hence, taking into consideration Remark 
(251 we can choose sequences a and f3 that satisfy the conditions of Lemma [231 Consequently 
the anchored graphons Wa and W'^ are isomorphic mod 0 through the identity map. If we now 
could show that Lq, is an isomorphism mod 0 between W and Wa , and that similarly P^g is an 
isomorphism mod 0 between W' and LL^, our proof would be complete. Due to symmetry we 
shall only show the first isomorphism. 
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First note that since (0, A, it) is a Lebesgue space, the mapping r„ is not only measurable and 
measure preserving as a mapping (O,^, vr) —)■ {TZ,}C,Ka), but also as a mapping (O,^, vr) —>■ 
{TZ, Aq). Let 


5 := {x € ri: Wa.iXa{x),Ta{y)) = W{x,y) for almost all y}. 

Since a is a regular anchor sequence, we have vr(5) = 1. Also, because W is almost twin- 
free, we can hnd a null-set N C ^ such that each twin-class of W has at most one point 
in T := S\N. Let F^ be the restriction of Fq, to T. Then it can easily be seen that T is 
injective. By |15[ Section 2.5], injective measure preserving maps between Lebesgue spaces 
have an almost everywhere defined measurable inverse. Thus F^ is an isomorphism mod 0, 
and then so is F^. 

Part (ii): First, by Corollary 1 171 we can find two almost twin-free strong Lebesguian graphons 
U G y^(o,B,p) U' G y^(0',B',p') corresponding weak isomorphisms 7 and 7 ' from W and 

W to U and U', respectively. By part (i) we then have that U and U' are isomorphic mod 0, 
hence for some measure preserving map r] : O ^ O' we have U = (U')'^. Now let y, : 0 ^ O' 
be defined through y{x) := r]{^{x)). Then clearly W = (U')^ almost everywhere, and the 
maps y and 7 ' are measure preserving from the completions of W and VF', respectively, into 
U'. 


□ 


7 A moment-indeterminate graphon 

In this last section we wish to provide an example of two real-valued graphons that possess 
the same homomorphism densities, but are not weakly isomorphic. In fact, in our example 
they are not inducing the same probability measure on M, so they are even distinguishable 
when forgetting about the geometry coming from the underlying product space. 

Let a and r be two probability distributions on N with finite moments and having the same 
moments (such distributions exist, see e.g. |14l Cor. 3.4]). Denote their n-th moments by 
(n > 0). 

Let further {SdiGN and {Tj}jeN be two partitions of [0,1] into measurable sets such that 
X{Si) = cr({i}) and X{Tj) = T{{j}) for all i,j G N. Consider the functions /c/r : [0,1] —>• M 
defined by 

fa{x) := Ux whenever x G Sn^, 

/r(x) := nix whenever x G 

respectively, and let W^, Wr ■ [ 0 , 1]^ —)• M be defined by Wcj{x, y) := fa{x)fa{y) and Wr{x, y) = 
/T(a:)/r(y), respectively. 

Let F be an M-decorated graph with each edge decorated with 1. By linearity, it is enough 
to show that t(F, VFo-) = t(F,WT-) for every such F. Let the elements of V{F) be denoted 
by , U 2 ,..., Ufc, and let di denote the degree of vertex Vi . It can then easily be seen that we 
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have 


t{F,Wa) = y n W{xi,Xj)dxi.. .Xk 



Similar calculations yield t(F, W^) = 0^=1 ^-^d so the two graphons do indeed have the 

exact same generalized moments. 


It remains to be shown that and WV yield different probability measures on M, but this 
easily follows from their product form, and the fact that a ^ t. 
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